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Abstract 

The design of optimal dynamic disturbance accommodation controller 
with limited model information is considered. We adapt the family of 
limited model information control design strategies, defined earlier by the 
authors, to handle dynamic controllers. This family of limited model in- 
formation design strategies construct subcontroUers distributively by ac- 
cessing only local plant model information. The closed-loop performance 
of the dynamic controllers that they can produce are studied using a per- 
formance metric called the competitive ratio which is the worst case ratio 
of the cost a control design strategy to the cost of the optimal control 
design with full model information. 



1 Introduction 

Recent advances in networked control engineering have opened new doors to- 
ward controlling large-scale systems. These large-scale systems are naturally 
composed of many smaller unit that are coupled to each other [IHl]. For 
these large-scale interconnected systems, we can either design a centralized or 
a decentralized controller. Contrary to a centralized controller, each subcon- 
troller in a decentralized controller only observes a local subset of the state- 
measurements (e.g., [5H7]). When designing these controllers, generally, it is 
assumed that the global model of the system is available to each subcontroUer's 
designer. However, there are several reasons why such plant model information 
would not be globally known. One reason could be that the subsystems con- 
sider their model information private, and therefore, they are reluctant to share 
information with other subsystems. This case can be well illustrated by supply 
chains or power networks where the economic incentives of competing compa- 
nies might limit the exchange of model information between the companies. It 
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might also be the case that the full model is not available at the moment, or 
the designer would like to not modify a particular subcontroller, if the model 
of a subsystem changes. For instance, in the case of cooperative driving, each 
vehicle controller simply cannot be designed based on model information of all 
possible vehicles that it may interact with in future. Therefore, we are interested 
in finding control design strategics which construct subcontroUers distributively 
for plants made of interconnected subsystems without the global model of the 
system. The interconnection structure and the common closed-loop cost to be 
minimized are assumed to be public knowledge. Wc identify these control design 
methods by "limited model information" control design strategies l8l|9|. 

Multi-variable servomechanism and disturbance accommodation control de- 
sign is one of the oldest problems in control engineering [TU] . We adapt the pro- 
cedure introduced in pUllTTj to design optimal disturbance accommodation con- 
trollers for discrete-time linear time-invariant plants under a separable quadratic 
performance measure. The choice of the cost function is motivated first by the 
optimal disturbance accommodation literature [inilll], and second by our in- 
terest in dynamically-coupled but cost-decoupled plants and their applications 
in supply chains and shared infrastructures [3113]. Then, we focus on the dis- 
turbance accommodation design problem under limited model information. We 
investigate the achievable closed-loop performance of the dynamic controllers 
that the limited model information control design strategies can produce using 
the competitive ratio, that is, the worst case ratio of the cost a control design 
strategy to the cost of the optimal control design with full model information. 
We find a minimizer of the competitive ratio over the set of limited model in- 
formation control design strategies. Since this minimizer may not be unique we 
prove that it is undominated, that is, there is no other control design method 
that acts better while exhibiting the same worst-case ratio. 

This paper is organized as follows. We mathematically formulate the prob- 
lem in Section m In Section [3J we introduce two useful control design strategies 
and study their properties. We characterize the best limited model information 
control design method as a function of the subsystems interconnection pattern 
in Section |4l In Section [SJ we study the trade-off between the amount of the 
information available to each subsystem and the quality of the controllers that 
they can produce. Finally, we end with conclusions in Section [51 

1.1 Notation 

The set of real numbers and complex numbers are denoted by M and C, respec- 
tively. All other sets are denoted by calligraphic letters such as V and A. The 
notation TZ denotes the set of proper real rational functions. 

Matrices are denoted by capital roman letters such as A. Aj will denote the 
j"^ row of A. Aij denotes a sub-matrix of matrix A, the dimension and the 
position of which will be defined in the text. The entry in the z*^ row and the 
j*^ column of the matrix A is . 

Let iS"^ (<5") be the set of symmetric positive definite (positive semidefinite) 
matrices in M"^". A > (>)0 means that the symmetric matrix A £ R"^" is 
positive definite (positive semidefinite) and A > {>)B means A — B > (>)0. 

g_{Y) and 'a{Y) denote the smallest and the largest singular values of the 
matrix Y, respectively. Vector denotes the column-vector with all entries 
zero except the i'^^ entry, which is equal to one. 
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All graphs considered in this paper are directed, possibly with self- loops, 
with vertex set {1, . . . , n} for some positive integer n. We say i is a sink in 
G = ({1, . . . , n}, iJ), if there does not exist j ^ i such that G E. The 

adjacency matrix 5e{0,l}"^"of graph G is a matrix whose entries are defined 
as Sij = 1 if (j, i) £ E and = otherwise. Since the set of vertices is fixed 
here, a subgraph of G is a graph whose edge set is a subset of the edge set of G 
and a supcrgraph of G is a graph of which G is a subgraph. We use the notation 
G' 3 G to indicate that G' is a supergraph of G. 

2 Mathematical Formulation 
2.1 Plant Model 

Consider the discrctc-time linear time-invariant dynamical system described in 
state-space representation by 

x{k -t- 1) = Ax{k) + B{u{k) + w{k)) ; .t(0) = xo, (1) 

where x{k) G M" is the state vector, u{k) 6 R" is the control input, and w{k) G 
R" is the disturbance vector. In addition, assume that w{k) is a dynamic 
disturbance modeled as 

w{k + l) = Dw{k) ; w{{)) ^wq. (2) 

Let a plant graph Gp with adjacency matrix S-p be given. Wc define the fol- 
lowing set of matrices 

A{Sv) = {Ae M"""" I CLij = for all l<i,j <n such that (sp)ij = 0}. 

Also, let us define 

B{eb) ^{Be M"^" I a{B) > et, = for all 1 < i ^ j < n}, 

for a given scalar > and 

V = {D e M"""" I dij = for alll < i ^ j < n}. 

We can introduce the set of plants of interest V as the space of all discrete- 
time linear time- invariant systems of the form ((1} and (0) with A G A{S-p), 
B G ^(eb), D G P, xo G M", and wq e K"- Since V is isomorph to A{Sv) x 
B{eb) X V X R" X M", wc identify a plant P G V with its corresponding tuple 
(A, B, D, Xq, Wo) with a slight abuse of notation. 

We can think of Xi G M, G M, and ui^ G M. as the state, input, and 
disturbance of scalar subsystem i with its dynamic given as 

n 

Xi{k + 1) = ^ o.ijXj{k) + bu{ui{k) + Wi{k)). 

We call G-p the plant graph since it illustrates the interconnection structure 
between different subsystems, that is, subsystem j can affect subsystem i only 
if (j, i) G E-p. In this paper, we assume that overall system is fully-actuated, that 
is, any B G B{eb) is a square invertible matrix. This assumption is motivated 
by the fact that we want all the subsystems to be directly controllable. 
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2.2 Controller 



The control laws of interest in this paper are discrete-time linear time-invariant 
dynamic state-feedback control laws of the form 

XK{k + 1) = AKXK{k) + BKx{k) ; xk{Q) = 0, 

u{k) = CKXK{k) + DKx{k). 
Each controller can also be represented by its transfer function 

CKizI~AK)-'BK + DK, 





\ Ak 


Bk ' 




[ Ck 


Dk \ 



where z is the symbol for one time-step forward shift operator. Let a control 
graph G]c with adjacency matrix Sk, be given. Each controller K must belong 
to 

1C{Sk.) = {K e Te"""" I kij = for all l<i,j <n such that {sK:)^J = 0}. 

When adjacency matrix Sjc is not relevant or can be deduced from context, we 
refer to the set of controllers as /C. Since it makes sense for each subsystem's 
controller to have access to at least its own state-measurements, we make the 
standing assumption that in each control graph G/c, all the self- loops are present. 

Finding the optimal structured controller is difficult (numerically intractable) 
for general Gic and G-p even when the global model is known. Therefore, in this 
paper, as a starting point, we only concentrate on the cases where the control 
graph Gjc is a supcrgraph of the plant graph G-p. 



2.3 Control Design Methods 

A control design method F is a mapping from the set of plants V to the set of 
controllers IC. We can write the control design method F as 



F = 



711 



7nl 



7lr 



In 



where each entry jij represents a map A{S'p) x B{ei,) x D TZ. Let a design 
graph Gc with adjacency matrix Sc be given. The control design strategy F 
has structure Gc if, for all i, the map F; = [7^1 • ■ • 7j„] is only a function of 
{[aji ■ ■ ■ CLjn],bjj,djj I {sc)ij 7^ 0}. Consequently, for each z, subcontroUer i is 
constructed with model information of only those subsystems j that (j, i) G Eq- 
We are only interested in those control design strategies that are neither a 
function of the initial state xq nor of the initial disturbance wq. The set of all 
control design strategies with the design graph Gc is denoted by C. Since it 
makes sense for the designer of each subsystem's controller to have access to at 
least its own model parameters, we make the standing assumption that in each 
design graph Gc, all the self-loops are present. 

For simplicity of notation, let us assume that any control design strategy 
F G C has a state-space realization of the form 



riA,B,D) = 



' Ar{A,B,D) 


Br{A,B,D) ' 


Cv{A,B,D) 


Dr{A,B,D) 
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where matrices Ar{A,B,D), Br{A,B,D), Cr{A,B,D), and DriA,B,D) are of 
appropriate dimension for each plant P = (A, B, D,xo,wo) £ V. The matrices 
Ar{A, B, D) and Cr{A, B, D) are block diagonal matrices since different sub- 
controllers should not share state variables. This realization is not necessarily 
a minimal realization. 



2.4 Performance Metrics 

We need to introduce performance metrics to compare the control design meth- 
ods. These performance metrics are adapted from earlier definitions in [8lll2j. 
Let us start with introducing the closed-loop performance criterion. 

To each plant P = {A, B, D, xo,wo) £ V and controller K ^ IC, we associate 
the performance criterion 

oo 

Jp{K)^^[x{kfQx{k) + (u(fc) -f- w{k) fR{u{k) + w{k))] 

k=Q 

where Q S >S"_|_ and R E 5"+ are diagonal matrices. We make the standing 
assumption that Q ~ R = I. This is without loss of generality because of 
the change of variables {x,u,iju) = {Q^^^x, R^^^u, R^^'^w) that transforms the 
state-space representation into 

xik + 1)= Q^/^AQ-^/^x{k) + Q^/^BR-^/\u{k)+ w{k)) 
= Ax{k) + B{u{k) + w{k)), 

and the performance criterion into 

oo 

Jp{K)^^[x{kfxik) + {u{k) + w{k)f{u{k) + w{k))]. (3) 

A:=0 

This change of variable would not affect the plant, control, or design graph since 
both Q and R are diagonal matrices. 

Definition 2.1 (Competitive Ratio) Let a plant graph G-p and a constant 
Eb > be given. Assume that, for every plant P E V , there exists an opti- 
mal controller K*{P) g K, such that 

Jp{K*{P)) < Jp{K), VK G IC. 

The competitive ratio of a control design method T is defined as 

.J.. Jpir{A,B,D)) 
rp{T) = sup i^(K*(P\\ ' 

with the convention that " equals one. 

Definition 2.2 (Domination) A control design method T is said to dominate 
another control design method V if for all plants P = {A, B, D, xq, wq) G V 

Jp(r(A, B, D)) < Jp(r'(A, B, D)), (4) 

with strict inequality holding for at least one plant in V . When F' G C and 
no control design method F G C exists that dominates it, we say that F' is 
undominated in C. 
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2.5 Problem Formulation 



For a given plant graph Gp, control graph G}c, and design graph Gc, we want 
to solve the problem 

arg min 7'-p ( r ) . ( 5 ) 

Tec 

Because the solution to this problem might not be unique, we also want to 
determine which ones of these minimizers are undominated. 



3 Preliminary Results 

In order to give the main results of the paper, we need to introduce two control 
design strategies and study their properties. 



3.1 Optimal Centralized Control Design Strategy 

In this subsection, we find the optimal centralized control design strategy K'^ (P) 
for all plants P £ P; i.e., the optimal control design strategy when the control 
graph Gic is a complete graph. Note that we use the notation K^{P) to de- 
note the centralized optimal control design strategy as the notation K*{P) is 
reserved for the optimal control design strategy for a given control graph Gjc- 
We adapt the procedure given in jlOllll| for constant input-disturbance rejection 
in continuous-time systems to our framework. 

First, let us define the auxiliary variables ^(fc) — u{k) + w{k) and u{k) — 
u{k + 1) — Du{k). It is evident that 



Augmenting 



i{k + l) = D£,{k)+u{k). (6) 
with the system state-space representation in ([T]) results in 



x{k 



A B 
D 



x{k) 

m 



+ 



i{k). 



In addition, we can write the performance measure in ^ as 
Jp{K) 



E 

fc=0 



" x{k) ' 


T 


■ x{k) ' 









(7) 



(8) 



To guarantee existence and uniqueness of the optimal controller K^{P) for any 
given plant P £ P, we need the following lemma to hold [13] . 



Lemma 3.1 The pair {A,B) with 



A B 
D 



B = 



(9) 



is controllable for any given P = [A, B, D,xo,Wo) € P. 
Proof: The pair {A, B) is controllable if and only if 



[ A^\l\j3 ] 



A -XI B 
D -\I 
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is full-rank for all A G C. This condition is always satisfied since all the matrices 
B e B{ei,) are full-rank matrices. ■ 

Now, the problem of minimizing the cost function in subject to plant 
dynamics in ([7]) becomes a state-feedback linear quadratic optimal control design 
with a unique solution of the form 

u{k) = Gix{k) + G2^(fc) 

where d G M"''" and G2 £ K"""". Therefore, we have 



u{k + l) = Du{k)+u{k) 

^ Du{k) + Gix{k) + G2i{k). 



(10) 



Using C(fc) = B~^{x{k + 1) - Ax{k)) in (HU]), we get 

u{k + 1) = Du{k) + Gix{k) + G2B-^{x{k + 1) - Ax{k)). (11) 

Putting a control signal of the form u{k) ~ XK{k) + DKx{k) in (|lip results in 

a;if(fc + 1) = DxK{k)+(DDK + Gi - G2B-M)a;(fc) + (Gs^-i - i:'A')a;(/e + 1). 

Now, because of the form of the control laws of interest introduced earlier in 
Subsection 12.21 we have to enforce G2-B~^ — Dk = 0. Therefore, the optimal 
controller K^{P) becomes 

XKik + 1) = DxK{k) + [Gi + DGaS-i - G2B-^A]x{k), 

u{k) = XK{k) + G2B-^x{k), 

with the initial condition xk{^) = again because of the form of the control 
laws of interest. 

Lemma 3.2 Let the control graph Gk. he a complete graph. Then, the cost of 
the optimal control design strategy for each plant P £ V is lower-bounded 
as 



where 



jp{Kh{p)) > 



Xo 


T 


■ Vn 


V12 ' 




X(i 


Bwq 




. V^2 


V22 




Bwq 



W + D^B-^ + DWD, 



V12 = -DiW + B-^), 
V22 - W + B-^, 

with the matrix W defined as 

W = A'^il + B^y^A + I. 

Proof: To make the proof easier, let us define 



(12) 
(13) 
(14) 



(15) 



Jp{K,p) = J2 



k=0 



( 


■ x{k) ' 


T 


■ x{k) ' 











pu{k)'^ u[k) 
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and 



i?;(P) =arg mm Jp (if, p). 



Using Lcmma lXn we know that K* (P) uniquely exists. We can find Jp {K* (P) , p) 
using X{p) as the unique positive definite solution of the discrete algebraic Ric- 
cati equation 

A^X{p)B{pI + B^X{p)B)-^B^X{p)A - A^X{p)A + X{p) - / = 0, (16) 
with A and B defined in (|9]). According to [TJ, we have 
X{p) > i^(Xf 1 + {l/p)BB^)-^A + I 

= I^{Xi - XiB{pI + B'^XiB)-^B'^Xi)A + /, 

where 

Xi = A^{I + {l/p)BB^)-^A + /. 
Basic algebraic calculations show that 



lim - XiBlpI + XiBy'B' Xi = 
where is defined in According to [T3], we know 

hm jp(if;(p),p)- jp(if2:(P)) 

p->-0+ 

and as a result 



X= lim X(p) > 



W 




" A 


B ■ 


T 




■ 




■ A 


B ' 





£> 















D 



Equivalently, we get 



Xii Xi2 
Xi2 X- 



22 



> 



A^WA + 1 A^WB 
BWA BWB + I 



Now, we can calculate the cost of the optimal control design strategy as 

Xll Xi2 
T 
12 

where 



jpiKhiP)) = 



Xq 


T r 







X'f2 X22 



Xq 

m 



(17) 

(18) 
(19) 



e(0) = G2B-^xo + Wo = -(^2"2'^r2 + DB-^)xo + Wo. 
If we put HH]) in ((TS]) and use the sub-Riccati equation 

X22 — I = BXiiB — BX12X22X12B, 

that is extracted from the Riccati equation in (116^ when p ~ 0, wc can simplify 
Jp{K*{P)) in (dHI to 



Xo 



-(Xa'a^XS + DB-^)XQ + wo 



-1 T 




X12 






^12 


X22 





Xo 



-{X22^XT2+DB-'')xo + 



Wo 



Xo 


T ■ 


Wo 




Xo 


T ■ 


Wo 





XiaXj-^X?; + B~^DX22DB~^ 



B-^ {X22 + DX22D ~ I)B-^ 
-X22DB-^ 



-B~^DX22 
X22 



Xo 
Wo 



-B-^DX22 
X22 



xo 

Wo 



(20) 
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Now, using (|17p it is evident that X22 > BWB + /, and as a result 

Vii V12B 



Jp{K*ciP)) > 







T r 


> 


Xo 






Wo 





BV^2 BV22B 



Xo 

Wo 



where Vn, V12, and V22 are introduced in ([T^ - ([n)) . The rest is only a straight 
forward matrix manipulation (factoring the matrix B). ■ 



3.2 Deadbeat Control Design Strategy 



In this subsection, we introduce the deadbeat control design strategy and give 
a useful lemma about its competitive ratio. 

Definition 3.1 The deadbeat control design strategy : ^(S'-p) x Z?(eft) x P — > 
/C is defined as 



r'^{A,B,D) = 



D 



-B-'D' 



-B-\A + D) 



Using this control design strategy, irrespective of the value of the initial state Xo 
and the initial disturbance wo, the closed-loop system reaches the origin just in 
two time-steps. Note that the deadbeat control design strategy is a limited model 
information control design method since 



rt{A,B,D)^-{z~du 



-^b-'^d^e^ 



b-^{A+D,) 



Xo 


T 


■ Qii 


Q12 " 




Xo 


Bwo 




Q12 


Q22 . 




Bwo 



for each 1 < i < n. The cost of the deadbeat control design strategy for any 
P = {A,B,D,xo,wo) &V is 



jp(r^(A,i?,i?)) = 



whc'i 

Qii 
Q12 

Q22^ A^B-^A + B 



I + D^{I + B-'^) + A^B~'^A + DA^B-'^AD + A'^B'^D + DB-^A,{21) 



-D - A^B-^ - DB-^ - DA^B-^A, 



(22) 
(23) 



The closed-loop system with deadbeat control design strategy is shown in Fig- 
ure\^a). This feedback loop can be re- arranged as the one in Figure\^b) which 
has two separate components. One component is a static- deadbeat control design 
strategy J3' for regulating the state of the plant and the other one is the deadbeat 
observer for canceling the disturbance effect. 

Lemma 3.3 Let the plant graph G-p contain no isolated node and Gjc 3 G-p. 
Then, the competitive ratio of the deadbeat control design method satisfies 
rpiT^)<{2el + l + ./l4TT)/{2el). 

Proof: First, let us define the set of all real numbers that are greater than 
or equal to r'p(r^) as 



M 



/3e 



JpiT^iA,B,D)) 
Jp{K*{P)) 



<f3 \/P(eP 
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It is evident that Jp{K^{P)) < Jp{K*{P)) for each plant P eP, irrespective 
of the control graph G/c, and as a result 



JpiV^iA^B^D)) ^ Jp{T^{A,B,D)) 



Jp{K*{P)) 



Jp{K*c{P)) 



(24) 



Using Equation ((24)) . Definition 13.11 and Lemma [3.21 we get that /? belongs to 
the set M if 



Xo 


T 


' Qii 


Ql2 




Xo 


Bwo 




Ql2 


Q22 . 




Bwo 


Xo 


T 


' Vn 


V12 " 




Xo 


Bwq 






V22 




Bwo 



(25) 



for aU A G AiSr), B e 6(ef,), D eV, xq e W\ and wq G M" where Qn, Q12, 
and Q22 are defined in (11T])-(1221) and Vn, V12, and V22 are defined in (IT^ - (ITi|) . 
The condition in (P5|) is satisfied if and only if 



PVn-Qii m2-Qi2 



>o, 



for all A G A{S-p), B G S(eb), and D E V. Now, using Schur complement |16j . 
we can show that /? belongs to the set Ai if both conditions 



and 



Z = (3V22 - Q22 

^ A^{I3{I + B^)-^ - B-^)A + (/3 - 1){B-^ + /) > 0, 

/3V^ii - Q11-W12 - Qi2][m2 - Q22]"M/3Vi^ - 012] > 0, 



(26) 



(27) 



are satisfied for all matrices A G A{Sp), B G B{ei,), and D G T). We can go 
further and simplify the condition in ([27]) to 



(28) 



P{W + DWD + D^B-^) - Qii 

- [-DZ + A^B-"^] Z-^ [-ZD + B-'^A] > 0, 

where Z is introduced in (^Sj) . For all /3 > 1 + l/fb, we know that Z > {(3 
1){B~'^ + 1) > and, as a result the condition 



(/3 - 1)/+^^ (/?(/ + B^)-^ - B-^ 

-{13 - 1)-^B-^{B-^ + I)-^B- 



A>Q 



(29) 



becomes a sufficient condition for the condition in 



to be satisfied. Conse- 



quently, /3 belongs to the set , if it is greater than or equal to 1 + 1/e^ and it 
satisfies the condition in (P^ . Thus, we get 

|/3 I /3 > {2el + 1 + y^4e2 + l)/(2e2)| c M. 

This concludes the proof. ■ 
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u(fc) 



w(fc) 

+ 



Plant 



(a) 



x^ik + 1) = Dx^(fc) - B-^D^x{k) 
uik) = x^ik) - B-\A + D)xik) 



w{k) 



Plant 



x^ik + 1) = Dx^ik) - B-'^D^x(k) 
u^Qi)=XE{k-)-B-^Dx{k-) 



x(k) 



Figure 1: The closed-loop system with (a) the deadbeat control design strategy 
and (6) rearranging this control design strategy as a static deadbeat control 
design and a deadbeat observer design. 



4 Plant Graph Influence on Achievable Perfor- 
mance 

First, we need to give the following lemmas to make proof easier. 

Lemma 4.1 Let the plant graph G-p contain no isolated node and Gjc ^ G-p. 
Let P = (A, B, D^xotWo) ^ V be a plant such that A is a nilpotcnt matrix of 
degree two. Then, Jp{K*{P)) = Jp{K^{P)). 

Proof: When matrix A is nilpotent, based on the unique positive-definite 
solution of the discrete algebraic Riccati equation in (jl6p when p = 0, the 
optimal centralized controller K^(P) becomes 



KhiP) = 



D 



D{L + B^)-^B-^A- B-^D^ 



-{L + B'^)-^BA- B-'-D 



Thus, K*c{P) e 1C{Sk.) because Gk: ^ Gp. Now, because K*{P) is the global 
optimal decentralized controller, it has a lower cost than any other decentralized 
controller K £ JC{Sic), and in particular 

Jp{K*{P)) < Jp{K*c{P)). (30) 
On the other hand, it is evident that 

MK*c{P)) < Jp{K*{P)). (31) 

The rest of the proof is a direct use of (j30[) and ([3T|) simultaneously. ■ 



Lemma 4.2 Fix real numbers a g 
x^ + {a + bxf >aV(l-h62). 



and b £ 



For any x G 



have 
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Proof: Consider the function x >-> + (a + bx)'^. Since this function is both 
continuously differentiable and strictly convex, we can find its unique minimizer 
as a; = —ab/{l + 6^) by putting its derivative equal to zero. As a result, we get 

+ {a + bxf >x^ + {a + bxf = a^/{l + b"^)- ■ 

Lemma 4.3 Let the plant graph G-p contain no isolated node, the design graph 
Gc be a totally disconnected graph, and G)c 3 G-p. Furthermore, assume that 
node i is not a sink in the plant graph G-p . Then, the competitive ratio of control 
design strategy F g C is bounded only if atj + bii{dr)ij{A, B, D) = for all j ^ i 
and all matrices A G A{Sp), B G B{eb), and D E V. 

Proof: The proof is by contrapositive. Assume that the matrices A G 
A{Sp), B G B{€b), D E V, and indices i and j exist such that i ^ j and 
aij+bii{dr)ij{A, B,D) ^ for some control design strategy F G C. Let 1 < £ < n 
be an index such that £ ^ i and {sp)u ^ (such an index exists because node i 
is not a sink in the plant graph). Define matrix A such that Ai = Ai, A( = ref , 
and At = for all t ^ i,£. It is evident that Ti{A,B,D) = r,{A,B,D) since 
the design graph is a totally disconnected graph. Using the structure of the cost 
function in (|3]) and plant dynamics in ([1]), the cost of the control design strategy 
F when wq = Cj and Xq = satisfies 

Jp(F(A B, D)) > {ue{2) + w,{2)f + x,(3)2 

= {ut{2) + wt{2)f + {rx,{2) + bu{ui{2) + Wi{2))f. 

With the help of Lcmma l4.2l and the fact that Xi{2) — {aij+bii{dr)ij{A, B, D))bjj 
(see Figured]), we get 

Jp{T{A, B, D)) > r'^x,(2fl{\ + b\i) 

= (oy + 6,,(dr).j(A, B, D)fb%r''l{\ + b\). 

The cost of the deadbeat control design strategy is 

Jp(F^(A, B, D)) = ejB^{A'^B-^A + B'^ + I)Be, 

Using the inequality 

Jp{T{A,B,D)) 
rp{r) = sup — /^^wpNN 
Pep Jp[K*(P)) 

r Jp{r{A,B,D)) Jp{r^{A,B,D)) 

pl^[jpiT^iA,B,D)) Jp{K*{P)) 

Jp{T{A,B,D)) 



-f^pJp{T^{A,B,D)y 
gives 



{dr)^JiA,B,D))^l 2 
{l + bUbl + l + alb',,/bl) ' 



This proves the statement by contrapositive. ■ 

Now, we are ready to tackle the problem ([5]). As the main results of the 
paper crucially depends on the properties of the plant graph, we split these 
results to two different subsections. 
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4.1 Plant Graphs without Sinks 

In this section, we assume that there is no sink in the plant graph, and we try 
to find the best control design strategy in terms of the competitive ratio and 
the domination. 



Theorem 4.4 Let the plant graph G-p contain no isolated node and no sink, 
the design graph Gq he a totally disconnected graph, and G/c 3 G-p . Then, the 
following statements hold: 

(a) The competitive ratio of any control design strategy T £ C satisfies r-p{T) > 
rpiT^)^{2el + l + ^l4TT)/{2el). 



(h) The control design strategy 
sink in the plant graph G-p . 



is undominated, if and only if, there is no 



Proof: First, let us prove statement (a). It is always possible to pick 
indices j ^ i such that {sp)ji ^ since there is no isolated node in the plant 
graph G-p. Let us define a one-parameter family of matrices {A(r)} where 



Mr) 



jef for each r € R. In addition, let B = et,! and D = I. According to 



Lemma r-p{r) is bounded only if r + ei,{dr)ji{r) = 0. Therefore, there is no 
loss of generality in assuming that {dr)ji{r) ~ —r/ei, because otherwise rp{T) 
is infinity and the inequality ^^(r) > rp(r^) is trivially satisfied (considering 
that using Lemma 13.31 we know rp{T^) is bounded). For each r G R, the 
matrix A(r) is a nilpotent matrix of degree two. Thus, using Lemma l4. 11 we get 
Jp{K*{P)) = Jp{K^{P)) for this special plant. The unique positive definite 
solution of the discrete algebraic Riccati equation in ([T5)) for a fixed r (when 
p = 0) is 



X = 



Air)^A{r) ehA(r)^ 
e,A{r) el/il + el)A{rrA{r) + ell 



I. 



Thus, the cost of the optimal control design strategy for 



_ (eg + l)(v/4igTT+l) 



and 



is equal to 



(6g + i)(y4igTT+i) 

^0 = e, - ej, 



Jp{K*{P)) 



(32) 
(33) 



(262 + ^4^2^+ 1)^4^2^:1 



2e2r2 



On the other hand, for each r G R, the cost of the control design strategy F for 
xq and Wq given in p2p and p3[) is lower-bounded by 



Jp{r{A,B,D)) > (M,(0)+w,(0))2+x,(l)^ 



{el + I)i3ely^l4 + 1 + 5el + Aef + y^^ + l + 1) 
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iv(0) = ivo 



w(l) = Dwq 



iv(2) = D^lVo 



x(0) = 




x(l) - Bwo 




x(2) = (A + BDy + D)Bw„ 




















XkW = 






x^m = 






x^(2) = BrBw„ 


1 












4 / 










u(0) = 




u(l) = D^BWo 




u(2) = CrBr^(l) + DrX(2) 



Figure 2: State evolution of the closed-loop system when xq ~ 0. 



Therefore, for any F G C, we have 



r-p{T) > lim 



Jp{T{A, B, D)) _2el + l + y^i4+T 



r^oo Jp{K*{P)) 



2e2 



(34) 



Considering the fact that F'^ also belongs to C, the rest is a simple combination 
of (j34p and Lemma [3.31 

Now, we can prove statement (&). The "if" part of the proof is done by 
constructing plants P = (A, B, Z?, xq, wo) £ V that satisfy Jp{V{A,B,D)) > 
Jp{T^{A, B, D)) for any control design method F e C \ {F'^}. For the "only if" 
part, we show that F® introduced later in ([55)1 dominates F'^ when G-p has at 
least one sink. See O P-124] for the detailed proof. ■ 

Theorem 14.41 shows that the deadbeat control design method F^ is an un- 
dominated minimizer of the competitive ratio r-p over the set of limited model 
information design methods C. 



4.2 Plant Graphs with Sinks 

In this section, we study the case where there are c > 1 sinks in the plant graph 
Gp. By renumbering the sinks as subsystems number n — c+1, . . . , n, the matrix 
S-p can be written as 



Sp — 



" {Sp)ii 


0(g-c)x{c) 


{Sp)21 


{Sp)22 



(35) 



where 



iSp)i 
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iSp)2 



{sp)n~cS 
isp)n-c+lS 

isp)n,l 



isp)l,n-c 

(^Sp')ji — c^n—c 
{sp)n-c+l,n- 



and (5*^)22 = diag ((s73)„_c+i_„_c+i, • • • , (sp)mi)- From now on, without loss 
of generality, we assume that the structure matrix is the one defined in psp . 
For all plants P E V, control design method F® is defined as 



D 



B-^DF{A, B)A- B-^D^ 



B-^{F{A, B) - I)A - B-^D 



(36) 
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where 

FiA, B) = diag (0, . . . , 0, fn-c+M, B),..., /„(A, B)) , 

and 

fiA,B) ^ 



+ + ! + v/(4 + &^P + 2(&^-4) + l 
for all n — c + 1 < I < n. 

The control design strategy applies the deadbeat to every subsystem that 
is not a sink and, for every sink, applies the same optimal control law as if the 
node were decoupled from the rest of the graph. 

Lemma 4.5 Let the 'plant graph G-p contain no isolated node and at least one 
sink and Gjc 3 G-p . Then, the competitive ratio of the design method intro- 
duced in V36\l is 



Mr' 



{2el + 1 + A/4eg + l)/(2eg), if{S-p)ii is not diagonal, 

1, */(5p)ii=0&(5p)22=0. 



Proof: Based the proof of the "only if" part of statement (&) of Theorem l4.41 
we know that 

Jp{V^{A,B,D)) < Jp{T'^{A,B,D)), 
for all P = {A, B, D, xq, wq) G V and as a result 

Jp{r^{A,B,D)) 



< suD Mr'^jA^B^D)) ^ 2el + l + ^44Tl 
- Pev Jp{K*{P)) - 2el 

Now if {Sp)ii has an off-diagonal entry, then there exist 1 < i,j < n — c and 
i ^ j such that {s-p)ji 7^ 0. Using the second part of the proof of Theorem 14.41 
it is easy to see 



rp(F«) > 



2el 



because the control design F® acts like the deadbeat control design strategy on 
that part of the system. Using both these inequalities proves the statement. 

If (S'-p)ii = and (8^)22 = 0, every matrix A with structure matrix S-p 
becomes a nilpotent matrix of degree two. Thus, according to Lemma 14.11 
we get that Jp{K*{P)) = Jp{K^{P)), and based on the unique solution of 
the associated discrete algebraic Riccati equation, for this plant, the optimal 
centralized control design is 

_ \ D I Djl + B^y^B-^A-B-^D^ ' 
" [ / I -{I + B')-'BA-B-'D 

which is exactly equal to r^{A,B,D). Thus, r-p(F®) = 1. 



Theorem 4.6 Let the plant graph Gp contain no isolated node and contain 
at least one sink, the design graph Gq be a totally disconnected graph, and 
Gjc 3 G-p . Then, the following statements hold: 
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(a) The competitive ratio of any control design strategy F G C satisfies r-p{T) > 
{2el + 1 + ^yAel + l)/{2el), if {Sv)ii is not diagonal. 

(b ) The control design method is undominated by all limited model informa- 
tion control design methods in C. 

Proof: First, wc prove statement (a). Suppose that (5*73)11 ^ and (5p)ii 
is not a diagonal matrix, then there exist l<i,j<ri — c and i ^ j such that 
{sv)ji 7^ 0. Consider the family of matrices A(r) defined by A(r) = rejef. 
Based on Lemma 14.31 if we want to have a bounded competitive ratio, the 
control design strategy should satisfy r + bjj{dr)ji{A{r), B, D) = (because 
node 1 < j < n — c is not a sink). The rest of the proof is similar to the proof 
of Theorem li^ 

See [HI p. 130] for the detailed proof of statement (&). ■ 

Combining Lemma 14.51 and Theorem 14.61 illustrates that if (S'-p )ii 7^ is 
not diagonal, the control design method F^ has the smallest ratio achievable 
by limited model information control methods. Thus, it is a solution to the 
problem ([5]). Furthermore, if {S-p)ii and {S-p)22 are both zero, then F® becomes 
equal to K* . This shows that F® is a solution to the problem ([5|) in this case 
too. The rest of the cases are still open. 

5 Design Graph Influence on Achievable Perfor- 
mance 

In the previous section, we solved the optimal control design under limited model 
information when Gq is a totally disconnected graph. In this section, we study 
the necessary amount of information needed in each subsystem to ensure the 
existence of a limited model information control design strategy with a better 
competitive ratio than F'^ and F^. 

Theorem 5.1 Let the plant graph G-p and the design graph Gc be given and 
Gk^Gv- Then, we have rp(F) > (2eg + 1 + ^4e^ + l)/(2e2) for all T € C if 
G-p contains the path i ^ j ^ £ with distinct nodes i, j , and I while {£,j) ^ Ec- 

Proof: See IH p. 132] for the detailed proof. ■ 

6 Conclusions 

We studied the design of optimal dynamic disturbance accommodation con- 
trollers under limited plant model information. To do so, we investigated the 
relationship between closed-loop performance and the control design strategies 
with limited model information using the performance metric called the com- 
petitive ratio. We found an explicit minimizer of the competitive ratio and 
showed that this minimizer is also undominated. Possible future work will focus 
on extending the present framework to situations where the subsystems are not 
scalar. 



16 



References 



1] F. Giulictti, L. PoUini, and M. Innoccnti, "Autonomous formation flight, 



Control Systems Magazine, IEEE, vol. 20, no. 6, pp. 34 - 44, 2000. 

[2] D. Swaroop and J. K. Hedrick, "Constant spacing strategies for platooning 
in automated highway systems," Journal of Dynamic Systems, Measure- 
ment, and Control, vol. 121, no. 3, pp. 462-470, 1999. 

[3] W. Dunbar, "Distributed receding horizon control of dynamically coupled 
nonlinear systems," Automatic Control, IEEE Transactions on, vol. 52, 
no. 7, pp. 1249 -1263, 2007. 

[4] R. R. Negenborn, Z. Lukszo, and H. Hellendoorn, eds., Intelligent Infras- 
tructures, vol. 42. Springer, 2010. 

[5] W. Levine, T. Johnson, and M. Athans, "Optimal limited state variable 
feedback controllers for linear systems," Automatic Control, IEEE Trans- 
actions on, vol. 16, no. 6, pp. 785 - 793, 1971. 

[6] M. Rotkowitz and S. Lall, "A characterization of convex problems in de- 
centralized control," Automatic Control, IEEE Transactions on, vol. 51, 
no. 2, pp. 274 - 286, 2006. 

[7] P. G. Voulgaris, "Optimal control of systems with delayed observation shar- 
ing patterns via input-output methods," Systems & Control Letters, vol. 50, 
no. 1, pp. 51 - 64, 2003. 

[8] F. Farokhi, C. Langbort, and K. H. Johansson, "Control design with limited 
model information," in American Control Conference, Proceedings of the, 
pp. 4697 - 4704, 2011. 

[9] F. Farokhi, "Decentralized control design with lim- 
ited plant model information," Licentiate Thesis, 2012. 
|http : / / urn . kb . se/ resolve ?urii=urn : nbn : se : kth : diva-63858 

[10] C. Johnson, "Optimal control of the linear regulator with constant distur- 
bances," Automatic Control, IEEE Transactions on, vol. 13, no. 4, pp. 416 



- 421, 1968. 

[11] B. D. O. Anderson and J. B. Moore, Linear Optimal Control. Prentice-Hall, 



[12] C. Langbort and J.-C. Delvenne, "Distributed design methods for linear 
quadratic control and their limitations," Automatic Control, IEEE Trans- 
actions on, vol. 55, no. 9, pp. 2085 -2093, 2010. 

[13] B. Molinari, "The stabilizing solution of the discrete algebraic Riccati equa- 
tion," Automatic Control, IEEE Transactions on, vol. 20, no. 3, pp. 396 - 
399, 1975. 

[14] N. Komaroff, "Iterative matrix bounds and computational solutions to the 
discrete algebraic Riccati equation," Automatic Control, IEEE Transac- 
tions on, vol. 39, no. 8, pp. 1676 -1678, 1994. 



1971. 



17 



[15] R. Kondo and K. Furuta, "On the bilinear transformation of Riccati equa- 
tions," Automatic Control, IEEE Transactions on, vol. 31, pp. 50 - 54, 
Jan. 1986. 

[16] F. Zhang, The Schur Complement and Its Applications. Springer, 2005. 



18 



